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ABSTRACT 

Designed to describe and evaluate classroom 
discussion of poems, this classroom interaction analysis systea 
consist of categories based on the work of Bellack and categories 
developed by the author specifically for analysis of poetry 
discussions* Some of the categories include teacher/pupil talk, 
analysis of solicitation and reaction moves, critical abilities, 
subject matter, and incorrect utterances* [This document is one of 
these reviewed in The Research Instruments Project (TRIP) monograph 
'•Measures for Research and Evaluation in the English Language Arts" 
to be published by the Committee on Research of the National Council 
of Teachers of English in cooperation with the ERIC Clearinghouse on 
Heading and Communication Skills* A TRIP review which precedes the 
document lists its category (Literature, Teacher Competency) , title, 
author, date, and age range (high school, postsecondary) , and 
describes the instrument's purpose and physical characteristics,] 
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The attached document contains one of the measures reviewed 
in the TRIP committee monograph titled: 

Measures for Research and Kvaluation 
In the English Language Arts 

! P TRIP is an acronym which signifies an effort to abstract 

and make readily available measures for research and evalua- 
tion in the English language arts* These measures relate to 
language development, listening, literature, reading, standard 
English as a second language or dialect, teacher competencies, 
or writing. In order to make these instruments more readily 
available, the ERIC Clearinghouse on Reading and Communication 
Skills has supported the TRIP committee sponsored by the Committee 
on Research of the National Coujicil of Teachers of English and 
has processed the material Into the ERIC system. The ERIC 
Clearinghouse accession numbers that encompass most of these 
documents are CS ^0/ J^o^CS J^^S^^ 
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Category? Literature, Teacher Competency 

Title: Describing and Evaluating Classroom Discussions of Poemr. 

Author J LaVonn M. Benson 

Age Range: Junior High-Post Secondary 

Description of the Instrument: 

Purpos e : To describe and evaluate classroom discussion of poems 

Date of Construction : 1971 

Physical Description : This measure la. a classroom Interaction analysis 
system consisting of categories based on the work of Bellack (see below) and of 
categories developed by the author specifically for poetry discussions t Classroom 
discussions are audio-taped and then transcribed, The analysis Is then carried 
out on the typed transcriptions. The categories of the system are as follows: 
teacher/pupil talk, pedagogical moves (structuring, soliciting, responding, reacting, 
leturn solicitation), analysis of solicitation and reaction moves (solicitation: 
assigning truth value or qualifying, constructing propositional functions, open 
comment; reaction: positive , admitting, negative, modifying), subject matter 
(sense, syntax, prosody, theme/tone, organization, non-critical point, personal 
criticlsra, criticiG^i'-'generai) , critical abilities (unrelated, peripheral, restatement 
explication, interpretation) , line count, incorrect utterances (poetic form, critical 
method, images , senses of words , syntax, basic meaning, reading in). 

Coding of the transcripts in these categories permits several kinds of data 
analysis. 

Reliability, Validity, and Notmative Data ; 

No reliability or validity data are reported in the study where DECDSP appears. 
Validity of the measure derives from itc basis in actual classroom observation of 



teacher-student interaction and its trials with teacher-^led poetry discussions 
in a number of classrooms* The categories do appear to account for all the 
"movea** in such a discussion. 

Reliability data could be obtained with conventional interrater reliability 
formulae* 

Data are reported from codings of transcripts of six poetry discussiomi in 
Nashville, Tennessee, secondary school classrooms. 

Orderi n g Informa tion : 
EDRS 

Related Documents : 

LaVonn M. Benson. Describing and Ev aluating Classroom Disc m ^sion of Poe try : 
A S^tud^ Using Principles of Literary Criticism . Ann Arbor, Michigan: University 
Microfilms, 1971. Order No 72-3822. 

Arno A. Bellack, at. al. The: Langua ge of the Classroom . New York: Teachers 
College Press, Teachers College, Columbia University, 1966. 



DESCRIBING AND EVALUATING CUSSROOH DISCUSSION ON POETRY, 

A srw>y USING mNcipiis OF urn 

by 



UVenn Mtrcell Benson 
MMt« of Science 
Florida State Unlveralty 



PCm\^S\QH TO PEPftOOUCE THIS COPV- 
filGHTfO MATERIAL HAS BEEN GRANTEO BV 

LaVorm Benson 



io ERIC AND OWGANiiATlONS OPtPAliNG 
UNOGB AGf<eEMf.NTSy*iTH tHE NATlO<4AC IN 
STiTg-TE OF EDlXATlON FURTHER PEPPO- 
OJCTJON Oi)TS»0E THE €RiC SYSTEM RE^ 

ouiftEs peR^•lSs^o^ or the copvright 

OVVNEf^ 



A Dl««.rt.tlon submitted in PartUl Fulflllam of 
Requlreaenti for tb« Dcgrse of 
Dt«:tor of Phlloaophy 
in the 
Englith D«p«rtaent 

of the 
Graduate School 

George p«»body College for Teicheri 
August 1971 



Apprevedi 



DESCfaBIMO AND EVALUATING CLASSROOK DISCUSSION 
OF SPECIFIC POEl'lS 



The categoiy system described here was constxnicted in 1971 by 
LaVonn hU Benson at George Peabody College for Teachers. It has been 
used in an analysis of the discussions of six 12th grade classes with 
a range of mean I. Q.*s and would probably be suitable for use in 
grades 10-*1^. 

This instxninent is designed to describe class discussions on 
pai^ticular poems and to gauge quantitativv^ly the quality of literaxy 
analysis in those discussions. It attempts to provide answers to such 
questions as thesei Who talked— the teacher or the students, and to what 
extent? What types of '^moves^' were made in the verbal interaction, and 
with what effect? What subject matter, from the standpoint of literaty 
analysis, Wv^s covered, and to what extent does it conform to teacher/in- 
vestigator expectations? V/hat level of critical ability is exhibited 
by participants in the discussion? The instiniment does not attempt to 
analyze non-critical 01 "off the subject" discussion, even though such 
peripheral discussion is recognized as appropriate and valuable. 

This category system rispresents an effort to build on the work of 
certain vei'bal interaction analysts by developing oategoriefi that make 
use of vooabula'jcy from literazy theoiy in order to describe and evaluate 
student and teacher poetiy discussion more precisely* Although a 
few items have already been deleted from tho original system, additional 
modification and refinement is needed. Still, analysing accoixJing to this 
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system provides useful infox^nation for teachers as well as for those 
in research* 

In scientific study the investigator should prooeedi as ir intoi*- 
action studies generally, by tape recording class discussions of a 
single poem, Typed transcxdpts should then be made from the tapes. 
Each teacher and pupil utterance i^hen coded accoxxiing to the seven 
categoiles in the system, The degree of reliability in coding should 
be ascertained by checking the results of independent coders. The 
ainount of discourse can be calculated throughout the system by counting 
the number of typewidtten lines for a given categoiy* The line count 
measurement for this instilment is a three-inch segment of transcript 
in elite type. 

The Categoiy System^ 
CATEXMRY 1 --Teacher/Pupil Talk 

The ratio of teacher talk to pupil talk is computed by adding the 
line counts (category 6) for t and £ codings. The frequencies as well 
as lengths of teacher and pupil utterances can also be determined, and 
the number of extended utterances (at least kO words) for each can be 
ascertained. 



1 

Two sources were used in the development of this system. Cate- 
gories 1, 2, and 3 rely heavily on the work of Avno A, Bellack et al. , 
The I^ncruage of the Classroom (New Yorki Teachers College Press, 
Teachers College, Columbia University, I966), Categoiy 5 was designed 
tvith details drawn from Seymour Chatman, An Introduction to the Lan^aee 
of Poetiy (Bostoni Houghton Mifflin Co., 19687^ 
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CATEGOfiY 2"Pedagogical Moves 

Bellack et found that the verbal intei-play of teacher and 
students was characterised by basic types of movesi initiatory moveSp 
which can be divided into structuring and soliciting moves, and reflex- 
ive moveSi which are composed of responding and reacting neves. (Bellack, 
pp, 16«19) Structuring moves are defined as those which set the context 
for subsequent behavior but which do not call for a response. These are 
coded on the tz*anscript str. Soliciting moves (coded sol ) solicit a 
response. Responding moves (coded res ) are those which occur as a i*e- 
suit of solViciting moves p and reacting moves (rea) are occasioned by 
any one of the other moves but are hot din^ct^Jy solicited by them. 

This instiniraent contains one move in addition to -pollack 's— chiefly 
a teacher move, which has been isolated because it occurs in classes which 
have high counts in extended pupil utterances and in total pupil lines. 
It is related to the solicitation in that it gets a response, but it . 
does not ask ostensibly for one. It is occasioned by a pupil response 
in the way that reactions are, but, xuilike reactions, it neitiier eval- 
uates nor modifies the pupil response. The teacher's behavior in 
this move is somewhat Jlke tMt of the non-directive counselor in that 
the teacher usually takes some of the words of the student's response 
and repeats them, giving virtually no direction on what should be done 
with them. This move generally leads students to clarify, expand, or * 
limit preceding statements. This teacher action is called the "return 
solicitation" and is coded rsol . (The sol label is not entirely ar- 
bitrary! the limited evidence on poetiy discussion indicates that high : ; 
frequencies in teacher solicitation correlate with the better discussions , 



whereas high frequencies in teacher reaction correlate with pooi'er 
discussions.) 

One additional symbol may occur in this category. Utterances 
which are not codable are labeled rjCp and such an utterance is not 
further coded in the remaining categories, Inaudible discourse or 
failure in the categoiy system to account for the utterance are Ikj's, 
CATEGORY 3--Analysis of Solicitation and Keaotion Koves 

The parts of the solicitation analysis taken from Bellack et. al, 
have not proved to be adequate, and this pax^ of the system needs to 
be revised* At this point, however^ the utterances coded sol in 
categoiy 2 should have one of the following codings in categoiy 3i 
a q . The solicitation directs the person addressed to assign ti*uth 
value— -yes/no—to the inforoiation given in the question or to 
qualify that infonnation. 

cpf « The person addressed should constract prepositional functions, 
as in "V/hat is a ...?" 

00. The person addressed should make a comment. This is the open 
comment question. (This item is an addition to the Bellack system.) 
Reaction moves are chiefly teacher moves. Utterances coded rea 
in categoiy 2 are analysed in this categoiy to show whether they are 
positively toned or negatively toned or whether they modify the pre- 
ceding statement by clarifying, expanding, or synthesizing. The 
following symbols, with the m^fil^ngs indicated, are usedi 

: Positively toned i 

£os— explicitly positive, as "Yes," "Right." 
adm—mlldly positively, as "All right," "Uh-huh." 
rjit—adnitting by repeating ov rephrasing, 
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Negatively toned i 

3^1— -iiKiicating roseivation, as in "Yes, but "Nevertheless. • 
nad— not admittingi stating the contraxy. 
rieg—explioitly negative, as "No," "Uh-xih/' 
Modifying I 

mod" clarifying, expanding, synthesizing. (This designation is 
used rather than gal above when the case is doubtful, ) 

Procedural actions (^ro) are coded in this category, and such 
utterances are not then further coded. Such statements as "Will you 
read?" or "Be quiet, Jim," are coded pro , 

CATEGORY ^--Subject Matter 

Five major headings have been devised for this categoiy to descidbe 
the basic critical areas which teachers and students are likely to be 
working in as they discuss a poem. The first two araas, Sense and Syntax, 
assume that students studying a poem will, in I, A, fiichai'ds* woixis, 
"make out its prose sense, its plain, ovei^t meaning," ( Practical Criti^ 
cism , p» 13) Areas 3i ^> and 5 assume that they will work out its in- 
tention as an organised structure. Subheads under these five major 
headings px'ovide for greater reliability in coding and pi*oduce data 
that is fairly specific. The subheads below a t'o appropriate to the poem 
used in the development of this system, and many of them apply to most 
short poems. However, the investigator may devise subheads that deal 
precisely with his experimental poem. The major headings, subheads, 
and their symbols are as followsi 
Sense se 

1) denotation of words, 2) the visual and auditory scene, 
3) ambiguity in words, and associations-allusions. 

Syntax 

1) kernal stinictures, 2) other structures, and 3) intonation/ 
pronunciation. 

■ Prosody £r ' 

1) meter and 2) other sound patterns. 



Theme/tone th 

1) statue^igeon description, 2) contests, 3) permanence, 
4) puns/ambiguities/ironic tone, 

Organization or 

1) space and time, 2) functions of pigeons/irony as or pidnciple. 

If the investigator wants to deteimine to what extent the teacher 
and students referred to specific Hnes of the poem in their discussion 
as opposed to simply discussing the poem in a general way, the method 
outlined below can be used. Furthemore, if the teacher/investigator 
wants to know what proportion of the discussion followed the "Lesson 
Plan" that he has prepared in advance, he can code as indicated to ob- 
tain this infoimtion. Following the major head and. subhead symbols, 
one of these letters is coded (in "general discussion" no subhead symbol 
is applicable) I 

a I specific line of the poem, anticipated in Lesson Plan. For 
example so2a— sense J the visual scene» line mentioned in this 
context in Lesson Plan, 

x« general discussion of the poem, anticipated in Lesson Plan. For 
example, se2x— sense} the visual scene j general discussion 
anticipated in Lesson Plan. 

bi specific line of the poem, not anticipated in Lesson Plan, 
jri general discussion, not on a point anticipated in Lesson Plan. 
These codings are useful for indicating such matters as 1) which classes 
tend to support their assertions by citing textual evidence, 2) which 
classes are able to mainUin abstract levels of analysis without getting 
into peidpheral areas, 3) v^ieh classes tend to propose unanticipated- 
and sometimes unlikely— intei-pretations, etc. 

Three additional heading are necessaiy in the subject matter cate- 
gory in oi«der to code discussion that is not specifically on the poem. 



The heading Non-critical point, nc£i is used when discussion veers into 
peldpheral areas of interest, Such discourse is of course expected and 



heading Personal criticism, crtp . is used to provide for personal op- 
inion about the value of the poem. If students support their evaluative 
judgments, the coding falls under "cidticism/r if they talk about the 



coded according to the subject matter headings above.) The heading 
Cidticism-general, crtg, provides for discussion on "the study of 
poetiy." Such matters as how poems are widtten or how we justify our 



CATEGORY 5— Critical Abilities 

The intention in this categoiy is to provide a xrtoans for making 
evaluative judgments on the quality of discussion on a poem on the basis 
of the level of cidtical ability reflected in the discourse. The headings 
in this categoiy represent a progression from *'first principles" used 
in the reading px'ocess, and basic skills in learning, to advanced 
principles used in poetry reading, ard advanced skills in learning, 
(See Seymour Chatman, An Int^uction to the Lan^>uage of Poetry . ) The 
first two levels do not actually represent critical ability in reading 
poetry I Um^elated (unr) and Peripheral (per). The first covers utterances 
of fact, belief, opinion, or private experience which, either within 
themselves or in the context of utterances preceding or following, are 
unrelated to the reading of the poem. The second is coded for like 
utterances which are only loosely related to the reading of the poem. 



beneficial, but this instx-ument 




poem in doing do. (Howaver, the utterance in many such cases can be 



statements about them are coded crtg. 
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The thlivi, fourth, and fifth labels Ih this category are vary broad i 
so that the oodar is only required to make a one-out-of-tl^ree decision 
on utterances which are clearly on the reading of the poem* The woi»d 
restatement trst. is used for the first of these levels i and the 
weaning appliedi in Chatman's woixiSr is ^"saying something in other words/' 
( Seymour Chatman,p, 39) Specifics covered by this heading represent 
"first stage" critical operations i giving the verbal equivalents of 
woixls I phrases i linea i giving definitions of words— denotationj idei it- 
iiying syntax— -subject-predicate stxnicture* The next critical ability 
is explication ^ exp i and it Involves critical activities that fall be- 
tween restatement arxJ interpr etatlon; Specific areas under this heading 
include restatement of a stanza or of the whole poem} definition of 
words^-^connotaticn and ambiguity} syntax--structures other than subject'^ 
predicate} analysis of meteri analysis of metaphor} recognition of artist- 
is quality in words and phrases} identification of ironic elementsv The 
highest critical ability leveli interpretation ^ i n t> applies chiefly to 
synthesizing skills • It includes utterances which deal in the follow-^ 
ingi synthesis of details of meaning, of metaphor, of connotative mean- 
ingSt of syntax, of sound sti-ucture} identification of o/erall design 
or structure} identification of the intention of the whole texti dis-* 
tinctions between the poem's •'public message" and the private expeilence 
it evokes} supported evaluation of the poem's artistic quality. 

Two additional symbols may appear in this category for the purpose 
of labeling statements that are made about criticism} 

crtx i The statement is clearly misinformed or misleading as a 

statement on criticism, 
crtgr The utterance is a statement on cidticismi not mlsinfonned 

or misleading. 
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CATEGORY 6— Line Count 

The number of linos for each utterance is coded in categoiy 6i 
One line of discourse equals a three-inch segment of transcidpt in 
elite type* A single utterance of less than three inches is counted 
as one line, 

CATEGORY 7"Incorreot Utterances 

The pui^pose of this categoiy is to identify and distinguish among 

the vaidous kinds of invalid statements that speakers make in discussions 

on a poem. Kaklng such classifications is of course difficult. The symbols 

Hsted below, with the designations indicated, represent a tentative 

effort toward labeling the kinds of deficiencies in poetry reading that 

may occur when teachers and students discuss poems. A good deal of re-^ 

vision needs to be done on this category. (Two of the classifications, 

Y and Z, are suggested by I, A. Richards, pp. 3IO-35I,) These letters 

^ V. are coded for incorrect utterances as indicated 1 

Ti poetic fora* The utterance distinctly reflects a faulty or 
Inadequate undei^standing of metidcal fom and sound sti-ucture 
in poetiy generally or in the poem studied. Such statements 
deal in meter, length of stanzas, sound in words, and the fun- 
ction of any of these in the poem. 

Oi critical method. The utterance indicates that the speaker has 
incorrect assumptions about how pootiy is read, analyzed, and 
studied. This classification covers a general area, and, there- 
fox'e, only the obvious misconceptions are coded U. 

V. images. The utterance ijxlicates that the speaker has failed to 
work out the image either by mlsconstming the woi^ds or by 
assuming that the woi^is should be taken literally. 

W. senses of words. The utterance indicates that the speaker does 
not understand the plain sense of the poem because he misundei*- 
stands what the woHs actually designate. 
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X« syntAX» Tho utterarice Indicates that the speaker does not 
understand the sense of the poem because he has not worked out 
the syntax properly. 

Y» falling short of the basic meaning. The uttei^ance indicates 
that the speaker fails to grasp the tone or intention of a part 
or the whole of the poem. The speaker has somehow failed to 
draw inferences from the evidence in the poem. This is a gen- 
eral classification and should be used with caution. 

Z« reading in. The utterance attilbutes meanings to the poem 
beyond those that can be validated by the poem itself. This 
classification also covers a general area and should be used 
with caution. 

Stidct guidelines are needed to insure consistency in the coding in 
this category. If an utterance reflects the speak<>r's inadequacy in 
more than one area, it should be coded in the most specific area pos- 
sible. The best practice is to code only the glaring deficiencies. 

After the typesoidpts have been coded according to the categories 
in the system, computerised data can be used to pi*oduce tables compar- 
ing the perfomance of the experimental classes in such areas as the^ei 
1) amount of teacher/ pupil discourse, 2) frequencies in teacher/pupil 
extended utterances, 3) analysis of pedagogical moves, 4) teacher sol- 
icitation analysis, 5) teacher/pupil reaction analysis, 6) subject 
matter, major headings analysis, 7) specif ic/general discussion in 
aubject matter, 8) teacher initiating Moves in subject matter areas, 
9) perfoi-mance in cidtical abilj ties, 10) incorrect uttex'ance per- 
foitnance, and 11) teacher/pupil incorrect utterance performance. 
Vaidous kinds of interesting correlations can be run on the data, 



